On the compilation of data-parallel languages on a distributed memory multithreaded environment with thread migration

نویسندگان

  • Christian Perez
  • Raymond Namyst
چکیده

This paper focuses on the use of distributed memory multithreaded environments in data parallel programs and has two main goals. The rst is to show that data parallel programs can support features like communication overlapping, load balancing without global data parallel object redistribution and the eecient use of clusters of uniprocessor and/or symmetric multiprocessors (SMPs). Our extended model introduces virtual processes. Virtual processes are implemented with mobile threads. The second goal is to determine the interactions between data parallel programs and a model of distributed memory multithreaded environments, with respect to intra-node communications and especially to thread migration. This paper also discuss this multithreaded environment with respect to the diierent models of threads and shows that the HPF and the C* data parallel compilation models easily integrate the proposed model. De la compilation de langages data-parall eles sur un environnement multithread a m emoire distribu ee incluant la migration de thread R esum e : Ce papier s'int eresse a l'utilisation des environnements multithread (processus l egers) a m e-moire distribu ee dans les programmes data parall eles. Il vise deux objectifs principaux. Le premier est de montrer que les programmes data parall eles peuvent int egrer des caract eristiques comme le recouvrement des communications par les calculs, l' equilibrage de charge sans redistribution globale des objets data parall eles et l'exploitation eecace des groupes de machines uniprocesseurs et/ou multiprocesseurs sym etriques (SMP). Notre mod ele etendu introduit les processus virtuels. Les processus virtuels sont impl ement es a l'aide de threads mobiles. Le second but du papier est de d eterminer les interactions entre les programmes data parall eles et un mod ele d'environnement multithread a m emoire distribu ee vis a vis des communications intra nnud et particu-li erement vis a vis de la migration de threads. Ce papier situe aussi cet environnement de thread par rapport aux autres mod eles de thread et montre que les mod eles de compilation data parall eles de HPF et C* s'int egrent facilement dans le mod ele propos ee. a m emoire distribu e, Migration de threads. On the compilation of data-parallel languages on a distributed memory multithreaded environment with thread migration3

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Compiling Data-parallel Programs to a Distributed Runtime Environment with Thread Isomigration

Traditionally, the compilation of data-parallel languages is targeted to low-level runtime environments: abstract processors are mapped onto static system processes, which directly address the low-level IPC library. Alternatively, we propose to map each HPF abstract processor onto a “lightweight process” (thread) which can be freely migrated between nodes together with the data it manages, unde...

متن کامل

The Thread Migration Mechanism of DSM-PEPE

In this paper we present the thread migration mechanism of DSM-PEPE, a multithreaded distributed shared memory system. DSM systems like DSM-PEPE provide a parallel environment to harness the available computing power of computer networks. DSM systems offer a virtual shared memory space on top of a distributed-memory multicomputer, featuring the scalability and low cost of a multicomputer, and t...

متن کامل

Distributed Java Virtual Machine with Thread Migration

of thesis entitled “Distributed Java Virtual Machine with Thread Migration” submitted by Wenzhang Zhu for the degree of Doctor of Philosophy at the University of Hong Kong in August 2004 Recent advances in better Java class libraries and Just-in-Time (JIT) compilation techniques have greatly improved the performance of Java to match that of C/C++. To fully exploit Java’s multithreading feature ...

متن کامل

JIT-Compiler-Assisted Distributed Java Virtual Machine

There is now a strong interest in high-performance execution of multithreaded Java programs in a cluster. Previous efforts to provide for such executions have either used static compilation tools that can transform multithreaded Java programs into parallel versions, or interpreter-based cluster-aware JVMs that offer the needed support. They failed however to be fully compliant with the Java lan...

متن کامل

Message-passing Over Shared Memory for the SECK Programming Environment

Message-passing is a representative communication model in today’s parallel and distributed programming, and should be efficiently supported even for multithreaded-only parallel programs. This papers describes the design and implementation of a communication mechanism which emulates message passing on top of shared memory for multithreaded applications. The mechanism is implemented in the DECK ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1997